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ABSTRACT 



ASSESSING ENGLISH LANGUAGE LEARNERS: A CASE STUDY 
OE PRACTICES USED BY SECONDARY 
MATHEMATICS TEACHERS 
by 

Ester Calderon Regalado, B.A. 

Texas State University-San Marcos 
May 2007 

SUPERVISING PROEESSOR: J. NATHAN BOND 
With the implementation in 2003 of the federal education law known as No Child 
Left Behind, students from all cultural and linguistic backgrounds, including English 
language learners (ELLs), are required to perform well on state assessments. Since the 
numbers of ELLs in schools are growing and since schools are held accountable for all 
students’ scores, the identification of effective instruction and assessments for ELLs has 
become increasingly more important for educators. This qualitative, case study 
investigated the assessment practices of five mathematics teachers in three high schools 
to determine the assessment measures that they selected for ELLs and the factors that 
influenced their decisions. Emerging from the data were four themes: (a) an intensified 
focus on state assessments, (b) changes in ESL instruction at the campuses, (c) 
ineffective state assessments for ELLs and (d) problematic identification of ELLs. 
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Although research suggests that effective teaching practices will help ELLs to learn, 
these teachers felt pressure to help their ELLs to succeed on the state assessments and 
thus, adjusted or abandoned what they knew to be best practice. The study showed that 
classroom teachers are selecting classroom assessments which help students to do well on 
state assessments but which may not accurately measure ELL academic progress. 




CHAPTER I 



INTRODUCTION 

Language minority education policy in the United States has gone through a 
number of changes over the last one hundred years. The 1906 Nationality Act required 
that immigrants coming into America speak English. This legislation eventually evolved 
with the help of federal courts into the policy of requiring bilingual education to be 
available to students attending public schools in the US (Texas Education Agency [TEA], 
2004). Major state and federal policy events continued to emphasize the responsibility of 
public schools to provide education in the native language of recent immigrants when 
possible (TEA, 1998). The mid-1980s English only movement led to state restrictions on 
bilingual education, and eventually schools began to focus on alternative methods of 
educating a continually growing number of school-aged recent immigrants to the US. 
Changes to language minority education policy continue today through the No Child Left 
Behind Act (NCLB) federal mandate to annually evaluate student performance on state- 
wide standardized tests and impose interventions if schools do not show Adequate Yearly 
Progress (AYP) (US Department of Education [USDE], 2006). 

When a standardized test is tied to negative consequences for failure, such as the 
risk of producing low school test scores or denying a diploma, it is called a high-stakes 
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test. High-stakes are involved in testing reeent immigrant students who are limited 
English profieient (LEP) through standardized measures and holding sehools responsible 
for the outeome (TEA, 2006b). Yet for both federal and state aeeountability proeedures, 
the pressure to inelude measurements of the performanee of EEP students eontinues to 
grow. Effeetive assessments for LEP students is a growing area of researeh and reeent 
findings on the extent of language demand and eultural effeets of test items help national 
leaders determine the best guidanee for state assessment proeedures (Abedi, 2004). 
Researeh suggests that LEP students, as well as all students, praetiee with assessments 
not only for the desired outeome on high-stakes assessments, but also for the reeognition 
that elassroom assessments play a eritieal role in student instruetion (Kopriva & Saez, 
1997). Effeetive instruetion for LEP students in the eontent areas requiring the lowest 
level of language demand, sueh as mathematies, offers an opportunity to effeetively 
assess students’ mathematieal potential and not their English language profieieney 
(Abedi, 2004). In addition, the performanee of LEP students in seeondary edueation 
eontinues to be a foeus for sehool distriets and the state (TEA, 2006e). 

Statement of the Problem 

A general laek of researeh exists on the assessment praetiees of seeondary 
teaehers of LEP students or English language learners (ELLs). Seeondary grade level 
mathematies eneompasses an inereasing demand on students to express eontent 
knowledge and the use of elassroom assessments to provide eontinuous feedbaek to 
students neeessary for them to gauge their own level of ability (Abedi, 2004; Kulm, 
1993). Classroom assessment praetiees vary with eaeh teaeher, presenting a ehallenge to 
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understand current practices (McMillan, 2004). Despite that fact, a critical role in 
effective instruction of LEP students includes providing effective classroom assessments 
that enhance student performance (Echevarria & Short, 2000). 

Purpose of the Study 

The purpose of this study was to determine the assessment practices that 
secondary mathematics teachers used with EEE students. The study focused on the 
practices of five secondary mathematics teachers at three high school campuses from an 
urban school district. Each campus was selected because it represented a distinct 
instructional program for EEE students. These include standard and alternative 
educational instruction, either of which provide instruction to EEE students in either 
English as a Second Eanguage (ESE) instruction or sheltered instruction. The ESE 
programs provided intensive English instruction by ESE endorsed teachers while students 
also attended regular classrooms with other English proficient students taught by content 
area teachers. The sheltered instruction programs provided separate classes for EEE 
students taught by content area teachers who had ESE training and who followed the 
regular scope and sequence of the curriculum (TEA, 2005). The two main goals of the 
study were to (a) determine the assessment methods that secondary mathematics teachers 
select when assessing EEE students and (b) identify the factors that influence that 
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Significance of the Study 

Sinee student performanee on mathematies assessments is least affected by 
language demands eompared to other eontent area assessments, the potential for LEP 
students to perform at their true level of eontent knowledge on assessments provides 
teaehers a unique window of opportunity for effeetive instruetion (Abedi, 2004). That is, 
LEP students have the greatest potential to reaeh higher aehievement levels in 
mathematies over other subjeet areas. Guidanee from the National Council on Teachers 
of Mathematies states that every student should have equitable opportunities to learn and 
that LEP students “should reeeive mathematies instruction in their first language as they 
work to aequire English profieieney” (NCTM, 2005, p. 1). Mathematies teaehers 
nationwide should be aware of and prepared to provide the supports needed for LEP 
students to aehieve mathematics content profieieney. 

The inereasing number of reeent immigrants to this eountry and growing need for 
researeh to inform edueators of effeetive and aeeurate measures of ELL student progress 
(Center for Researeh on Edueation, Diversity & Exeellenee [CREDE], 2003) guided this 
study. The findings of this study will provided information on elassroom assessment 
practiees that eomplements ongoing researeh on effective assessment of LEP students. 
These findings may be used by teaehers to shape instruetion and by sehool leaders to 
guide assessment praetiees. Researeh on assessment praetiees also eontributes to the 
aeeurate measurement of LEP student aehievement in state or federal aeeountability 



systems. 
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Definition of Terms 

1 . Biased Test Items: the systematie under-measurement or over-measurement of a 
student’s “true” skill (Kopriva & Saez, 1997). 

2. Bilingual Edueation (BE): edueation instruetion that uses and promotes two 
languages, although there are varying degrees of formal instruction in both 
languages and varying degrees of fostering of bilingualism within each bilingual 
education program (Baker, 2006). 

3. Current EEP - students identified as EEP and currently served through the EEP 
(Bilingual or ESE) program (Texas Administrative Code [TAC], 2006). 

4. English Eanguage Learner (ELL): term used in most current education research to 
describe students with limited English proficiency. 

5. English as a Second Language (ESE): required in the Texas Education Code, 
English as a second language programs enable EEP students to become competent 
in the comprehension, speaking, reading, and composition of the English 
language through the use of second language methods, and emphasize the mastery 
of English language skills, as well as subject area academic skills (Texas 
Education Code [TEC], 2006). 

6. Language Proficiency Assessment Committee (LPAC): required by the Texas 
Education Code, the LPAC committee is formed for each EEP student comprised 
of a campus administrator, EEP program teacher and parent; whose role is to 
initiate, articulate, deliberate, and determine the best instructional program for the 
student; and make appropriate decisions regarding placement, instructional 
practices, assessment, and special programs that impact the student (TEA, 2004). 
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7. Limited English Proficiency (LEP); students who have a home language other 
than English are identified as limited English proficient (EEP) and are required by 
the Texas Education Code to be provided with a full opportunity to participate in 
a bilingual education or English as a second language program (TEC, 2006). 
These students are also known as English language learners (EEE). 

8. Einguisticahy Accommodated Testing (EAT): an alternative assessment process 
that enables recent immigrant English language learners to have assistance in 
understanding the language used on the statewide achievement test (TEA, 2007a). 

9. Monitored EEP - students who have met the criteria to exit the EEP (Bilingual or 
ESE) program and are no longer classified as EEP but are in their first or second 
year of monitoring as required by state statute (TAC, 2006). 

10. Objective Test Items: test items that avoid any bias, offensiveness or unfair 
penalization (McMillan, 2004). 

11. Reading Proficiency Tests in English (RPTE) - state assessments specifically 
designed for EEP students to measure English language proficiency in reading 
aligned to state reading content standards and English language proficiency 
standards (TEA, 2007c). 

12. Sheltered Instruction: a model of educational instruction using a series of 
methods and techniques to help English language learners more easily understand 
and acquire English and content area knowledge and skills (Echevarria & Short, 
2000). 

13. Sheltered Instruction Observation Protocol (SIOP): a research-based framework 



for the sheltered instruction model that identifies several indicators of effective 
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instruction and can be used to guide teachers’ lesson planning and training 
(Eehevarria & Short, 2000). 

14. Spanish Texas Assessment of Knowledge and Skills (TAKS) assessments: 
eligible LEP students who meet the state testing requirements with Spanish 
versions of the TAKS assessments. The assessment is available in Grades 3 
through 6 for speeifie subjeet areas (Texas Student Assessment Results, 2006). 

15. Texas Assessment of Knowledge and Skills (TAKS): mandated by the state 
legislature in 1999, TAKS measures the statewide eurrieulum in reading, writing; 
English Eanguage Arts, mathematics, science, and soeial studies (Texas Student 
Assessment Results, 2006). 

16. Texas English Eanguage Profieiency Assessment System (TEEPAS): the 
expanded system of Texas English language profieieney assessments were 
implemented to address the testing requirements of the federal No Child Eeft 
Behind Aet, and is eomprised of two assessments — the Reading Profieiency Tests 
in English (RPTE) and the Texas Observation Protoeols (TOP) (TEA, 2007e). 

17. Years in U.S. schools - the number of years of enrollment in U.S. sehools of EEP 
students is reported on eaeh assessment doeument submitted as part of the testing 
requirement for these students (TEA, 2007e). 




CHAPTER II 



REVIEW OE POEICY AND EITERATURE 

History of Eanguage Minority Education Policy 
The history of language minority edueation poliey in the United States began at 
the turn of the 20**' eentury. The 1906 Nationality Aet required immigrants to speak 
English in order to be naturalized into this eountry (Baker, 2006). In 1918, a Texas 
statute was implemented that made it a misdemeanor for any teaeher to use a language 
other than English in sehool (TEA, 1998). Both federal and state English immersion 
polieies persisted until 1954 with the US Supreme Court ruling of Brown v. the Board of 
Education. This landmark Supreme Court deeision reversed the 1896 ruling that allowed 
raeial segregation within faeilities of equal quality, deelaring that separate publie sehools 
for blaek and white students were inherently unequal (Walsh, 2005). The mandate paved 
the way for publie sehool integration and laid a foundation for future legislation. In 
1968, the Bilingual Edueation Aet, Title VII of the Elementary and Seeondary Edueation 
Aet (ESEA), established the first federal poliey for bilingual edueation and alloeated 
funds for innovative programs to reetify the unique disadvantages faeed by non-English 
speaking students (Walsh, 2005). Texas state legislation was passed in 1968 that allowed 
sehool distriets to provide bilingual instruetion, although no state funds were appropriated 
for implementation (TEA, 1998; TEA, 2004). 
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Several events followed from 1971 to 1978 that would “dramatieally ehange the 
eourse of bilingual edueation in the United States” (TEA, 1998, p. 4). An ongoing 
federal eourt ease on desegregation. United States vs. State of Texas, (1971) required two 
Texas sehool distriets to eonsolidate and implement a eomprehensive program of 
bilingual/bieultural edueation (Walsh, 2005). Shortly after, the Texas Bilingual 
Edueation and Training Aet reinforeed bilingual edueation serviees for students identified 
as limited English profieient (EEP). In 1974, the US Supreme Court ruling in Lau v. 
Nichols found that identieal edueation does not eonstitute equal edueation under the Civil 
Rights Aet (TEA, 2004). The passage of the Equal Opportunity Edueational Aet of 1974 
(EEOA) allowed an individual to initiate eivil aetion if he or she was denied equal 
edueational opportunity (TEA, 1998). 

As a results of these historieal events, along with Texas legislation, federal policy, 
and federal court rulings from 1980 to 1995, the bilingual education policy in place for 
Texas public schools was strengthened. Beginning in 1986, Texas legislation and 
administrative rules focused on curriculum and assessment of EEP students and 
established a Spanish-language version of the statewide assessment. At the same time, 
state administrative rules were established to allow school districts under certain 
circumstances to exempt students from the statewide test (TEA, 1998). In 1995, the 
Reading Proficiency Test in English (RPTE) was required for EEP students who were 
previously exempt from the statewide assessment and was developed to evaluate their 
progress in English language attainment. Eour years later the RPTE was required of all 



EEP students (TEA, 1998). 




10 

Even with legislative emphasis on bilingual education programs and equal 
educational opportunities for LEP students, both Texas and federal rules failed to address 
the educational needs of EEP students in secondary grades. In 1973 and 1981, when 
presented with the opportunity to specify the grade levels of bilingual education program 
requirements, LEP students in grades 7-12 were either not discussed or a consensus could 
not be reached on the best methods of instruction (TEA, 1998). 

Legislative advances in providing effective educational programs for LEP 
students prescribed the use of bilingual education programs nationwide. In 1983, 
national policy debates began on the passage of legislation to establish English as a 
dominant national language. In 1998, California Proposition 227, along with similar 
legislation in Arizona and Massachusetts, implemented restrictions on native-language 
instruction, impacting bilingual education (TEA, 2004). Educational research efforts 
began to focus on alternative methods of instruction for LEP students. 

Effective Instruction for ELL Students 

Researchers of bilingual education consider the term itself “a simplistic label for a 
complex phenomenon” (Baker, 2006, p. 213). Baker described the range of bilingual 
education instruction from that which seeks to transition a student to a dominant, majority 
language, to that which attempts to maintain the home language of a child, and even 
attain dual language proficiency. Since 1985, Cummins' research on second language 
development has served as a major source of several language acquisition theories that 
support the positive impact of bilingual education (National Association for Language 
Development in the Curriculum [NALDIC], 2007). Cummins’ threshold hypothesis 
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suggested that continued conceptual and linguistic development of a student’s first 
language helps him learn a second language. Threshold hypothesis assumes that a child 
needs to “achieve a certain level of proficiency or competence in the first language.” A 
minimum threshold of linguistic and conceptual knowledge in the first language is 
needed in order to successfully add a second language (NALDIC, 2007, p. 4). 

Recently, strong evidence was presented to support the effectiveness of dual 
language programs (Collier & Thomas, 2005). This federally funded longitudinal study, 
the National Study of School Effectiveness for Language Minority Students — Long-term 
Academic Achievement, was conducted over the course of 20 years and based on over 2 
million student records. The study compared seven instructional programs in an effort to 
identify the most effective for LLP students. The programs were: (a) English immersion 
in language classes, (b) ESL taught by pullout from a mainstream classroom, (c) ESL 
taught through academic content, (d) transitional bilingual education (TBE) and ESL 
taught traditionally, (e) TBE and ESL taught through academic content, (f) one-way 
developmental bilingual education, and (g) two-way bilingual immersion. Collier and 
Thomas concluded that two-way bilingual immersion or dual language methods are the 
most effective form of instruction for LEP student in the long term. Collier and Thomas 
also provided evidence that the least effective method for LEP students is mainstream 
English-only, and that students in bilingual education programs outperform students 
schooled in English only (CREDE, 2003). 

Research on instructional methods for secondary school LEP programs includes 
work by Ereeman (2003), who studied middle and secondary students. The key elements 
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of his suggestions for effective instructional programs in higher-grade levels included: (a) 
using theme-based curriculum, (b) drawing on students’ background and culture, (c) 
using collaborative instructional strategies and scaffolded instruction, and (d) creating 
confident and valued students. His research was motivated by the concern among 
educators of the growing number of older recent immigrant students in the middle and 
high school grades who were unprepared for school. He outlined three distinct types of 
older English language learners as (a) recent arrivals with adequate formal schooling, (b) 
recent arrivals with limited formal schooling, and (c) US schooled students without 
adequately developed language skills in either their first language or English. 

Echevarria and Short (2000) also investigated effective EEP student instruction. 
Their sheltered instructional model incorporates many forms of effective teaching 
strategies that, taken together, are useful for instructing EEP students. The model 
requires no use of the student’s native language and may be used by any content area 
teacher. The same research team introduced the Sheltered Instruction Observation 
Protocols (SlOP), a tool used by school districts to assess the instructional methods of 
ESE content area teachers and gauge their effectiveness. 

Texas’ EEL Students 

In many states nationwide, school districts are required to identify EEP students 
by the use of a home language survey administered upon school enrollment (Celedon- 
Pattichis, 2004). In Texas, bilingual education programs are required for school districts 
with at least 20 EEP students through grade 6 but are optional in secondary grades (TAG, 
2006). The Texas Administrative Code also requires school districts with less than 20 
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students to offer ESL instruetional program; however, waivers are offered for compelling 
reasons such as lack of sufficient staff or resources. Based on a longitudinal cohort study 
conducted in 2002 by the Texas Education Agency, most EEP students in Texas by the 
time they reach middle school are receiving all of their instruction in the regular, all- 
English instructional program (TEA, 2002a). This report also provided evidence of a gap 
in performance between EEP and non-EEP students in meeting the exit-level testing 
requirement citing as one factor, the low performance of students who were still receiving 
EEP program services in grade 1 1 . The most current information available on the 
performance of EEP students in Texas secondary schools is found on the statewide 
Academic Excellence Indicator System report, which indicates EEP student performance 
on the statewide Texas Assessment of Knowledge and Skills (TAKS) is among the 
lowest of eight reported disaggregated student groups (TEA, 2006c), as shown in Eigure 
1 . 




All African Hispanic White Special Economically LEP At-Risk 

American Education Disadvantaged 



Disaggregated Student Groups 

Figure 1 

2006 Texas Academic Excellence Indicator System, Percent Met Standard 



Percent of students tested that met the TAKS passing standard, summed over all grade levels 
tested and excluding Grade 8 Science. 
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Whether due to the eoncem for LEP student performanee in general or the 
dramatie inerease in the number of LEP students in US sehools, researeh in effeetive 
instruetional methods for LEP students is in inereasing in demand (CREDE, 2003). 
Certainly, the performanee of LEP students in seeondary grade levels in Texas is one 
motivating faetor (TEA, 2006e). Coupled with the testing results used in state and 
federal aeeountability systems, there is a growing desire for sehool distriets to edueate 
LEP students in an effeetive manner. 

Measuring ELL Student Aehievement 

On January 8, 2002, the No Child Left Behind Act of 2001 (NCLB) was signed 
by the President of the United States and established accountability provisions to begin in 
2003. The Act required all public school districts, campuses, and states to be annually 
evaluated for adequate yearly progress (TEA, 2006b). Texas established the state 
accountability system in 1994 and has always been considered the “driving education 
policy for the entire nation” (McNeil, 2005). Despite that perception, one of the many 
assessment and accountability requirements introduced by NCLB included the reporting 
of disaggregated student performance results. One such student group which had not 
previously been required in the state accountability system was LEP students (Abedi, 
2004; TEA, 2006a). In addition, NCLB testing requirements for LEP students led to the 
creation of the Texas English Language Proficiency Assessment System (TELPAS) and 
TAKS linguistically accommodated testing. 

The importance of incorporating LEP student tests in school accountability 
systems was recognized as early as 1999 when it became evident that many states were 
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effectively ignoring LEP student (Ruiz de Velasco, 2005). Although NCLB required that 
all students, including LEP, be included in the AYP determinations, the use of assessment 
results for Texas LEP students dramatically changed. Originally, the US Department of 
Education recognized the Texas RPTE assessment results, yet only in part. By late 2006, 
the USDE determined that the RPTE would not be used in AYP and the only assessment 
recognized to measure LEP student performance would be the same assessment used by 
all students via the TAKS results (TEA Letter to the Administrator, November 13, 2006). 

The change in the use of the RPTE by the USDE marked another shift in the 
policy focus on LEP student performance away from measuring English language 
attainment toward that of sheer content proficiency. Ruiz de Velasco (2005) presented 
the broader question of “whether it is appropriate to attach high-stakes consequences to 
[English Language Learner] ELL student test performance” (p. 49). In 2006, Texas 
recognized the focus on the academic progress of ELL students and for the first time 
provided a new ELL Progress Measure that reported student results of progress on the 
RPTE or meeting TAKS proficiency in reading (TEA, 2006d). The student performance 
of LEP students on the RPTE has not been included as a measure in the state 
accountability system (McNeil, 2005; TEA, 2006a) and the new ELL progress measure 
will not be part of the state accountability system for at least two more years (TEA, 
2006a). The growing number of LEP students in Texas and the nation has caused 
concern with LEP success in state assessment programs (CREDE, 2003), and changes to 



the use of the assessment results for LEP students reflect that concern. 
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Providing appropriate, equitable and valid performanee assessments for LEP 
students eontinues to be a eritieal topie of edueational researeh (Solano-Flores & 
Trumbull, 2003). Research on the topic of assessment practices is limited, particularly to 
classroom assessment practices. Sanchez and Brisk (2004) provided helpful information 
on the complexity of LEP student assessments practices. They stated that classroom 
assessments are not part of the NCLB mandate, and there are no resources to ensure 
quality classroom assessments. They concluded that personal factors affect teacher 
decision making in the use of teacher-created assessments. Other research indicated that 
effective assessments are those that link student learning outcomes to teacher decision 
making and improvement in student performance (McMillan, 2004). Current trends in 
classroom assessment practices include formative assessment, or providing assessment 
during instruction rather than at the end of instruction, and promoting student 
engagement in the assessment process. Recursive assessments practices include the 
“continuous flow” of information to students and continuous adjustment of instruction 
based on their results (McMillan, 2004a, p. 16). 

New instructional methods for LEP student instruction such as Sheltered 
Instruction include requiring teachers “to assess and provide feedback” to LEP students 
in order to help students evaluate their progress (Echevarria & Short, 2000). Local 
school districts have also recognized the critical role of classroom assessments. A recent 
school district Bilingual/English as a second language instructional program evaluation 
report recommended that English language learners should be taught how to assess their 
own academic progress so that they can recognize when additional support is needed. 
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Classroom Assessments 

Classroom assessment methods vary just as mueh as instructional methods for 
students (McMillan, 2004). Traditional assessment practices include summative 
assessments that evaluate at the close of instruction at either the end of a unit or after a set 
period. Teachers have traditionally used objective tests that measure specific skills using 
unbiased questions or scenarios. Researchers in effective strategies for student 
performance in statewide high-stakes tests suggest exposure of students to testing formats 
that help prepare them for large-scale standardized assessments, which may explain the 
continued use of traditional testing methods (Kopriva & Saez, 1997). 

Current research on effective assessments for LEP students suggest radically 
different methods than those described above. Research on the effect of culturally 
sensitive test items showed that the effect of culture is great, in fact, that tests are 
considered “cultural products,” and assessment practices must build on cultural heritage 
and learning styles (Celedon-Pattichis, 2004; Kopriva, 2000; Solano-Flores & Trumbull, 
2003). Other research supports the use of authentic assessment, which includes direct 
examination of a student’s ability to perform tasks (Echevarria & Short, 2000; McMillan, 
2004a). Other assessment strategies include concurrent assessments in which EEP 
students are given the same test items in both English and their native language (Solano- 
Elores & Trumbull, 2003). In addition, the use of multiple assessments or “multiple 
pathways for students to demonstrate their meaning of the content” (Echevarria & Short, 
2000) is suggested as an effective assessment and instructional method for EEP students. 
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In addition to exploring the various types of assessments, research has also been 
conducted on the factors that influence those selections. Research conducted by Sanchez 
and Brisk (2004) on the classrooms assessment practices with bilingual students found 
that bilingual teachers and bilingual program staff based their decisions on how to assess 
students on both school organizational factors and personal factors. Organizational 
factors included a fragmentary district wide assessment system and lack of professional 
development to help staff understand and use assessments. Personal factors that affected 
the choice of assessments were related to the teacher’s or specialist’s (a) level of English 
proficiency, (b) level of preparation and knowledge of measurement and assessment, and 
(c) level of acculturation to the American system. McMillan (2004a) also provided study 
results that determined two factors that influence teacher assessment practices: (a) the 
teacher beliefs and values about teaching and learning and (b) the external pressures, 
which “cause teachers to engage in certain practices that may not be in the best interests 
of student learning” (p. 18). 

Why Mathematics? 

In addition to research on the types of assessments, research on the content area 
language demand reveals the effect of language demand on LEP student performance in 
content area tests. Abedi (2004) found that the highest level of language demand occurs 
in student tests in reading and that the effect on the performance of EEP and non-EEP 
students was great. The effect was smaller in mathematics and the smallest in math 
calculation; however, the effect became larger for mathematics as the grade levels 
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increased where there is greater language demand. Adedi eoneluded, “The performanee 
of LEP students may be underestimated by assessment results” (p. 9). 

Polieies that may influenee LEP student performanee in mathematies have also 
been investigated. In her researeh on the plaeement of LEP students in mathematies 
elasses, Celedon-Pattiehis (2004) studied polieies and praetiees in sehools and eoneluded 
that exeellent performanee of LEP students is possible if adequate elassroom plaeements 
are made and ensured. The sehool must foeus “on the student’s mathematieal potential 
rather than [the] student’s English language profieieney” (p. 189). 

In a position statement from the world’s largest mathematies edueation 
organization, the National Couneil of Teaehers of Mathematies (NTCM) stated that every 
student should have equitable and optimal opportunities to learn and that key deeision 
makers should understand issues related to equity in mathematies edueation (NCTM, 
2005). NTCM supports the use of alternative and authentie assessment praetiees, 
eurrieula that are eulturally relevant, and methods of instruetion that are eulturally 
sensitive. Effeetive mathematies instruetion that affeet LEP student performanee 
outeomes is more important today due to the growing population of LEP students, and 
the effeetive elassroom assessment praetiees that play a eritieal role in providing that 
instruetion (CREDE, 2003). 

Similar Studies on Classroom Assessment 

Lew studies speeifieally evaluate elassroom assessment praetiees for either ESL 
or mathematies instruetion. One study by Cheng, Rogers, and Hu (2004) eompared ESL 
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and English as Foreign Language (EEL) college instructors from Canada, Hong Kong, 
and China to determine differences in classroom assessment practices. They found that 
differences in teacher classroom assessments practices were based on the purpose of the 
assessment, the method of assessment, and the beliefs and attitudes of the instructor, 
including the Ending that instructors who experienced little external pressure for student 
performance on standardized assessments selected authentic assessments in non-objective 
formats. In another study, Kulm (1993) explored mathematics teachers’ use of 
alternative assessments to measure higher-order thinking. He found that students 
instructed in mathematics were well served by authentic assessments, multiple 
assessments and alternative assessments and that teacher professional development in the 
area of alternative assessments improved the classroom instruction in higher order 
thinking. Kulm also noted, “Many educators believe that very little change will occur in 
mathematics curriculum and teaching without concurrent change in testing, especially 
state and national standardized tests that are used to assess and compare student, school, 
and district performances” (p. 1). An evaluation of the Vermont assessment program and 
specifically the evolution of the state portfolio program, Koretz (1994) found that use of 
portfolios as an alternative assessment led to changes in instruction. He found that 
portfolio assessments were supported by principals and parents, despite the belief of 40% 
of the teachers in his study “that student learning is ‘neither better nor worse’” as a result 
(p. 28). Finally, Lara-Alecio, Parker, Irby, Mason and Avila (1997) explored the use of 
manipulative-based mathematics assessments for Hispanic LEP students. Although they 
caution that the number of study participants was too small to draw valid conclusion, they 
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found that “a student’s language skills were largely irrelevant to task performanee” (p. 
23). 



Theoretical Framework 

The theoretical framework for this study is based on the major topics of research 
provided in this chapter. Four areas of research that provide a basis for discussing the 
findings of this study are: (a) language acquisition theory of threshold hypothesis, (b) 
LEP instructional program effectiveness, (c) use of authentic assessment for mathematics 
instruction, and (d) studies on classroom assessment practices. The threshold hypothesis 
presented by Cummins promotes continued development of a student’s first language in 
order to achieve proficiency in a second language (NALDIC, 2007). Findings presented 
by Collier and Thomas (2005) provide clear evidence that two-way bilingual immersion 
instructional methods are the most effective form of instruction for LEP students. 
According to Kulm (1993), mathematics teachers’ use of alternative assessments 
improves classroom instruction in higher order thinking. Personal factors, external 
pressures and/or external statewide assessments also influence teacher assessment 
practices (Abrams, 2004; Cheng, Rogers, & Hu, 2004; Rex & Nelson, 2004; Sanchez & 



Brisk, 2004). 




CHAPTER III 



STUDY DESIGN AND PROCEDURES 

This case study focused on the teacher assessment practices on three secondary 
high school campuses. Each campus was selected to represent distinct instructional 
programs for EEE students, either standard or alternative educational instruction, offering 
ESE regular instruction or sheltered instruction for the EEE students. The three 
campuses represent the combinations of (a) standard educational instruction offering ESE 
regular instruction, (b) alternative education instruction offering ESE regular instruction, 
and (c) standard educational instruction offering ESE sheltered instruction. Background 
information for each campus included general information on the instructional programs 
offered for students, descriptive statistics of campus enrollment and student 
characteristics, and the most recent EEP student performance results. 

Role of the Researcher 

My role was that of a participant researcher (Yin, 2003). I reviewed the policy 
issues, presented the study topic to participants, and began the dialogue to obtain the 
information from teachers as they discussed their own assessment practices. I conducted 
the interviews and observed the classrooms of the selected teachers. The interviews were 
conducted in an informal conversation and discussion format, which allowed the 
participants sufficient time to present their point of view and create rich dialogue. A 
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naturalistic, semi-structured interview protoeol, where eaeh subsequent interview 
question was based on the partieipants’ answers, was followed. I kept the overall foeus 
on the study question, while allowing the teachers to eontrol the flow of the eonversation 
(Yin, 2003). Beeause of the informal nature of the interview, I included questions on life 
history to gain insight on the teachers’ common experiences and baekground. 

Deseription of Partieipants 

Five teaehers were seleeted for this study, four female and one male. All were of 
Hispanie deseent and their number of years of teaehing experienee ranged from three to 
twenty-two years, with ages ranging from early twenties to early sixties. Two teachers 
were born in Mexieo and migrated to the US and one teaeher was of Cuban deseent. All 
were bilingual in English and Spanish and had learned both languages from an early age. 

All were certified in mathematies, but only one was eertified to teaeh ESL 
students. Eour teaehers reeeived training for the TEEPAS Texas Observation Protoeol 
assessment rating proeess, whieh is required for EEP students. Three of the five teaehers 
were responsible for providing ESE sheltered instruction, and the other two teachers 
taught regular mathematies elasses with ESE students ineluded. 
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Table 1 

Case Study Participants 
















School* 


Name* 


Gender 


Teaching 

Cert. 


Additional 

Cert. 


TOP** 

Training 


Teaching 

Assignment 


Standard 

Instruction/ 


Erwin 


Mary 


Female 


Math 


None 


Yes 


Sheltered 


ESL Regular 




Cathy 


Female 


Math 


None 


Yes 


Sheltered 


Alternative 


Instruction/ 


Alton 


Amy 


Female 


Math 


ESL 


Yes 


Regular 


ESL Regular 


Standard 

Instruction/ 


Sheldon 


Francis 


Female 


Math 


None 


Yes 


Sheltered 


ESL Sheltered 




Van 


Male 


Math 


None 


No 


Academy/ 

pull-out 



* Pseudonym 



** Texas Observation Protocol rater training 



Selection of Participants 

The participants in this case study were selected based on their role in serving 
LEP students from each of the three case study school campuses. Two mathematics 
teachers were selected from a standard educational instructional campuses based on 
recommendations from the assistant principal. Only one ESL mathematics teacher was 
selected from the alternative education campus because of the small number of EEE 
students on that campus. The mathematics teachers selected from the second standard 
instructional campuses were based on recommendations from professional development 



staff 
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Sources of Data 

Five seeondary mathematies teaehers serving ELL students were interviewed for 
this study. The interviews were eondueted to understand the assessment methods used by 
eaeh teaeher for both regular students and ELL students. The teaeher interviews were 
held at a loeation suggested by the teaeher, typieally the teacher’s classroom. Joint 
interviews were held for teaehers from one eampus, a deeision that provided synergy and 
added to the discussion format of the interview. Eaeh partieipant was assured 
eonfidentiality and signed a eonsent form. The length of the interviews was one hour, 
and eaeh interview was reeorded. Lollow-up interviews were limited to olarifieation of 
their previous responses. See Appendix A for the interview protoeol and partieipation 
eonsent form. Lesson plans or other yearly classroom assessment schedules were 
requested of eaeh teaeher to determine the frequency of student assessment. Deseriptive 
statistics were provided from data available on the state edueation website. Summaries of 
eampus eharaeteristics and performanee information are provided for eaeh of the ease 
study sites. 



Data Analysis Proeedures 

Data analysis began immediately after data was eollected from the first partieipant 
using a eonstant eomparative approaeh (Strauss, 1967). Audio tapes of eaeh interview 
were transcribed in order to summarize the data into themes. Sinee all of the interviews 
were eondueted in a diseussion format, the interview guide served to ensure that all of the 
areas eritieal to the study were discussed. Eaeh response was eompared to the previous 
response after eaeh interview. The data from eaeh teaeher interview were transeribed and 
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summarized to identifying reeurring themes or eategories. The interview guide also 
provided a framework for the summary for the data analysis. The data were summarized 
into the following eategories: (a) demographie information, (b) philosophieal views, (c) 
elassroom assessment praetiees, (d) English profieieney identifieation, (e) assessment 
aeeommodations, (f) aeademie profieieney identifieation, (g) eampus support serviees, 
and (h) grading modifieations. After all interviews, the full set of eategories were 
reviewed to ensure that all eomments by the partieipants were ineluded. Finally, a eopy 
of the transeribed notes was provided to eaeh of the partieipant to validate the 
information eolleeted. 



Study Trustworthiness 

Qualitative study teehniques were followed by the researeher to provide ereditable 
ease study results. Purposive sampling was applied based on the problem of the study, 
where partieipants were seleeted from different eampus sites to offer typieal and 
divergent data therefore maximizing the range of information obtained (Erlandson, 

Harris, Skipper & Allen, 1993). The researeher applied direet data eolleetion through a 
naturalistie approaeh to the interview-diseussion. The interview guide provided a 
framework to reeord the teaehers’ seleetion of assessments in order to eapture how they 
had ehanged their ehoiees and why. In addition, the interview-diseussions were foeused 
on the perspeetives of the teaehers, speeifieally, the assessments and instruetion for FEE 
students based on their point of view. The interview ineluded an in-depth situational 
analysis, or teaehers’ seleetion of assessments, with rieh dialogue generated through 
open-ended questions (Yin, 2003). Narrative deseriptions were reeorded based on the 
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assumption that nothing that was shared by the partieipants was trivial or unimportant 
which led to rich data collection. Member checking (Erlandson, et ah, 1993) was applied 
at the end of each interview as the data were summarized and each respondent was 
allowed to immediately correct errors or challenge interpretations. A constant 
comparative method of data analysis (Glaser & Strauss, 1967) was employed to identify 
common emerging themes from the data collected. Finally, triangulation (Erlandson, et 
ah, 1993) was applied to the study by the use of multiple sources of data through (a) the 
selections of three interview sites, (b) review of campus, school district and state EEE 
policy, and (c) descriptive statistical data. 

Descriptive Statistics of Selected High School Campuses 
Selected Urban School District 

The school district selected for this study was a large urban school district in an 
ethnically diverse state. According to statistics, over 81,003 students attended the district 
in 2005-2006 school year. The school district provided services for students from Early 
Childhood Education to secondary grade levels. The students in secondary grades 7 to 12 
made up 39 percent of the total district enrollment. EEE students numbered 19,353, or 24 
percent of the district enrollment. According to the latest Bilingual/ESE program 
evaluation report, the district EEE performance results lagged behind the state average in 
all grade levels, with the greatest gap in grade 6 reading and mathematics. Of all EEL 
students served in the district, English as a Second Language programs serve 32 percent, 
typically found in the secondary grade levels in this state. Of the remaining students, 63 
percent were served through bilingual education, while the parents of 4 percent did not 
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approve any services. Approximately 1,250 (or 6 percent) of all ELLs were eligible to 
exit the LEP program based on passing the state’s required assessment. Only 21 percent 
of those eligible to exit the EEP program were in grades 9 through 12. 

Erwin High School Campus: Standard Instruction Offering ESE Regular Instruction 

Erwin High School, a pseudonym, was selected for this case study because it 
represented a high school offering standard educational instruction for all students and 
ESE content area instruction for EEE students. The high school campus had 1,555 
students enrolled in the 2005-2006 school year. This campus served grades 9 through 12, 
although it was among the three smallest high schools in the district (excluding 
alternative high schools). However, the campus served a large EEP student population of 
over 300 students or 22 percent of the campus population. Based on instructional 
program financial information for this campus, there were four teachers identified on this 
campus as serving students in the ESE program (see Table 2). 



Table 2 

Selected High School Campuses: General School Characteristics 



Limited English Proficient (LEP) Students 





Total Fall 
Enrollment 


No. of 


Percent 


No. of 
Teacher 






Students 




FTEs* 


Erwin High School 


1555 


343 


22% 


3.8 


(Standard/Regular) 










Alton High School 

(Altemative/Regular) 


303 


5 


2% 


0.0 


Sheldon High School 

(Standard/Sheltered) 


2351 


224 


10% 


1.7 



FTE: Full Time Equivalents 
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Erwin High School was established in the mid-fifties and has educated three 
generations of students. The eampus had a long history of eommunity partnerships with 
local universities and eommunity dropout prevention programs. Currently the sehool 
programs foeused on (a) sehool-to-eareer aeademies, (b) ninth-grade transitions to high 
school life, and (c) math test seores and math curriculum alignments. 

Overall student performanee results for this eampus were 30 pereentage points 
lower than the statewide results and 25 pereentage points lower than the district results, 
as shown in Table 3. Mathematies results were the lowest among the subjeet areas, and 
only 14 pereent of LEP students met the profieieney standard in mathematies. 
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Table 3 

Selected High School Campuses: Percent of Students Meeting 
Proficiency Standard 






All Assessment Results 






State 


District 


Campus 


LEP 

Students 


Erwin High School 
( Standard/Regular) 


67% 


62% 


37% 


9% 


Alton High School 
(Alton High School) 


67% 


62% 


55% 


* 


Sheldon High School 
( Standard/Sheltered) 


67% 


62% 


43% 


8% 






Mathematics Assessment Results 




State 


District 


Campus 


LEP 

Students 


Erwin High School 
( Standard/Regular) 


75% 


70% 


42% 


14% 


Alton High School 
(Alton High School) 


75% 


70% 


71% 


* 


Sheldon High School 
( Standard/Sheltered) 


75% 


70% 


51% 


17% 



Data are not available when very few students in a group are assessed in order to comply with the Family 
Educational Rights and Privacy Act (FERPA). 



Although over 300 LEP students were enrolled in the Erwin High School campus, 
only 245 EEP students had performance results. This included both currently served and 
monitored EEP students who had exited from the LEP program. An estimated 65 percent 
of the 245 LEP students had been enrolled in EIS schools for over five years. LEP 
students who had exited the LEP program on this campus outperformed all other non- 
LEP students in grades 9 and 10 as shown on Table 4. Among all grades with LEP 
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students tested, 12* grade LEP students outperformed other grades with 26 pereent 
meeting profieieney on mathematies assessments. 



Table 4 












Selected High School Campuses: Student Mathematics Assessments Results 




Students Tested 


Student Performance 




Grades 

9-12 


% All 
Students 


Grade 9 


Grade 10 


Grade 1 1 






Erwin High School (Standard/Regular) 




All Students 


863 


100% 


38% 


35% 


56% 


LEP Students: 












Current 


190 




13% 


9% 


26% 


Monitored 1st Year 


28 




20% 


45% 


* 


Monitored 2nd Year 


27 




63% 


63% 


* 


Total 


245 


28% 








Non LEP Students 


618 


72% 


48% 


39% 


63% 






Alton High School (Altemative/Regular) 




All Students 


108 


100% 


* 


63% 


73% 


LEP Students 


N/A 




N/A 


N/A 


N/A 






Sheldon High School (Standard/Sheltered) 




All Students 


1541 


100% 


43% 


45% 


64% 


LEP Students 












Current 


138 




16% 


10% 


29% 


Monitored 1st Year 


24 




33% 


11% 


* 


Monitored 2nd Y ear 


16 




* 


27% 


* 


Total 


178 


12% 








Non LEP Students 


1363 


88% 


47% 


49% 


67% 



* Data are not available when very few students in a group are assessed in order to comply with the 
Family Educational Rights and Privacy Act (FERPA). 

N/A: Tested students and performance results are not available for Current and Monitored LEP Students. 
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Alton High School Campus: Alternative Instruction Offering ESL Regular Instruction 

The seeond eampus seleeted for this ease study was one that provided alternative 
instruetion for seeondary students while offering regular ESL programs. Alton High 
Sehool, a pseudonym, was an open enrollment aeademie sehool of ehoiee designed to 
meet the needs of students through a non-traditional, self-paeed approaeh to learning. 

The total enrollment of this eampus was 303 students in 2005-2006, and 57 pereent were 
12* grade students. Only five students were identified as LEP students during that sehool 
year. 



Alton High Sehool was designed to offer an approaeh that strengthened the belief 
that students are the solution for the issues that affeet their lives. The solution-foeused 
intervention model offered all sehool staff specifie skills for fostering strengths in 
students. Whether students were at-risk of, or dropout youth, eaeh was eneouraged to 
graduate from high sehool and sueoessfully transition to eollege and work. 

Table 3 shows the overall student performanee for Alton High Sehool was only 
12 pereentage points behind the state average and seven points lower than the distriet 
average. Mathematics results for all students on this eampus exeeeded the distriet 
average. Performanee results for this alternative eampus exeeeded that of the other two 
eampuses in this ease study; however, the LEP student assessment results for this eampus 



were too few to report in 2005-2006. 
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Sheldon High School Campus: Standard Instruction Offering ESL Sheltered Instruction 

The third campus included in this study, Sheldon High School, a pseudonym, 
represented a high school that provided standard instruction and offered ESL sheltered 
instruction. This campus served grades 9 through 12 and was the second largest high 
school campus in the district with an enrollment of 2,35 1 students in the 2005-2006 
school year. The LEP student population was approximately 100 students fewer than that 
of Erwin High School, yet comprised only 10 percent of the entire student body (see 
Table 2). Only two teachers were identified on this campus as serving students in the 
ESL program based on campus financial program information. 

Sheldon High School was a new campus in the school district that opened in the 
fall of 2000 with 9th and 1 0th graders. The school graduated its first senior class in 2003. 
There were innovative school redesign efforts, partnerships with regional educational 
boards, and support from national foundations. Also in place were small learning 
communities, or academies, designed to foster mentoring of students by teachers and 
frequent collaboration between teachers from different disciplines. 

Student performance results for this campus are shown in Table 2. Sheldon High 
School had higher performance results than Erwin High School; however, the overall 
performance results was 24 percentage points lower than statewide results and 22 points 
lower than the district average. Like Erwin High School, mathematics results were the 
lowest among the subject areas, yet with a slightly higher result of 17 percent of LEP 
students meeting the mathematics proficiency standard. An estimated 75 percent of the 
178 students tested were enrolled in US schools for over five years. Similar to Erwin 
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High School, the 12**' grade LEP student results were highest among all LEP student in 
other grades, yet only 29 pereent met the mathematics proficiency standard (see Table 4). 



All three campuses had been evaluated by both the state and federal 
accountability systems for the last three years. As mentioned earlier, the student 
performance results for EEE students was used in the evaluation of the federal AYP 
determinations. The campus state accountability results indieated that all eampuses were 
rated “Academically Acceptable” for the last three years, as shown on Table 5. 



Table 5 

Selected High School Campuses: State Accountability Results 




2004 


2005 


2006 


Erwin High School 
(Standard/Regular) 


Academically 

Acceptable 


Academically 

Acceptable 


Academically 

Acceptable 


Alton High School 
(Altemative/Regular) 


Not Rated 


Academically 

Acceptable 


Academically 

Acceptable 


Sheldon High School 
(Standard/Sheltered) 


Academically 

Acceptable 


Academically 

Acceptable 


Academically 

Acceptable 



In contrast, the AYP results for two of the three campuses indicated that the EEP student 
group performanee adversely affected the federal aceountability results, as shown in 



Table 6 (TEA, 2006e). 
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Table 6 

Selected High School Campuses: Federal Accountability Results 



2004 


2005 


2006 


Erwin High Sehool 
( Standard/Regular) 


Did Not Meet* 


Did Not Meet 


Did Not Meet 


Math LEP Student 
Group Met Standard? 


Yes 


No 


No 


Alton High Sehool 
(Alternative/ Regular) 


Meets 


Meets 


Meets 


Math LEP Student 
Group Met Standard? 


- 


- 


- 


Sheldon High Sehool 
( Standard/Sheltered) 


Did Not Meet 


Meets 


Did Not Meet 


Math LEP Student 
Group Met Standard? 


- 


- 


No 



* Meets or Did Not Meet Adequate Yearly Progress 

" - " indieates that the LEP student group did not meet the minimum size eriteria for evaluation. 




CHAPTER IV 



FINDINGS 

This case study provided valuable information on the issues that mathematies 
teaehers of ELL students eneounter eaeh day. The first section describes the results from 
the seleeted high sehool eampuses and then in the next seetion, the four eommon themes 
emerging from the ease study data are presented. 

Erwin High Sehool: Standard Instruetion/ESL Regular Instruetion 

The teaehers interviewed from Erwin HS, Mary and Cathy (pseudonyms), were 
intensely foeused on the upeoming state assessments. Both teaehers were instruetors of 
sheltered ESL classes and had also taught regular elasses in whieh ESL students were 
ineluded. Both Mary and Cathy were dedieated to ESL students, referring to them as 
“my favorites” and “extremely hard workers.” These teaehers were eomfortable with 
providing some instruetion in the student’s native language but foeused on the attainment 
of English aeademie language skills for mathematies. Mary and Cathy deseribed the 
sheltered instruetional team as effeetive, with speeific eoordination among the 
mathematies sheltered instructional teachers. In addition, these ESL teachers provided a 
separate Saturday elassroom for additional instruetion to thirty ESL students. Student 
partieipation in the weekend classes was voluntary. Both Mary and Cathy clearly 
supported of the aeademie progress of ESL students and strongly opposed to the use of 
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alternative assessments or accommodations to obtain that goal. Grading modifications 
were not used in order to focus on the goal of academic proficiency. Mary and Cathy felt 
that any modification to tests or grades “would be hurting the students.” Both felt that 
the external pressure to have students perform well on state assessments had increased 
over the last year, and they believed that the sheltered instruction classes offered for ESL 
students had been limited as a result. 

Alton High School; Alternative Instruction/ESL Regular Instruction 

Amy, a pseudonym, taught at Alton High School, the alternative instruction 
campus. She spoke frankly about effective instruction to ELL students in English 
without any use of a second language, noting “to do it right, you need to be consistent, 
and if you have a team that teaches ELL students, you have to agree on the approach as a 
team.” Amy described the students on this campus as dedicated to completing the high 
school requirements. The academic setting of Alton High School provided an avenue for 
students to complete their high school requirements for graduation. This included both 
course requirements and successful completion of the state assessment in grade 1 1 (TAG, 
2006). Alton High School offered instruction at a self-paced rate. Amy described the 
opportunities for one-on-one instruction in this academic setting that allowed her to 
gauge each student’s performance closely. Amy’s classroom assessments mirrored the 
state assessments; however, she allowed her ELL students to use either English or 
Spanish versions of a test. Although Amy applied some grading modifications, her use of 
alternative assessments or accommodations was limited. Lor Amy, the primary goal of 
instruction was for the student to pass the Grade 1 1 state assessment in English. 
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Sheldon High School: Standard Instruction/ESL Sheltered Instruction 

Sheldon High School teachers Francis and Van, pseudonyms, were interviewed 
for this study. Both teachers had used alternative assessments, such as performance 
assessments, presentations, and demonstrations, in the prior school year. Francis and Van 
believed that to be effective with ELL students, teachers must provide a “safe 
environment” where they “feel comfortable” and have “some common ground” with their 
instructors. Previously, they had taught as a team for a class of ESL students who were 
“pulled-out” of several classes for separate instruction. Their familiarity with alternative 
methods of instruction was fresh on their minds, but they admitted that during the current 
school year they had used more traditional assessment methods. Both described that 
although the pullout program was still in place during the current school year at Sheldon 
HS, ELL students were not the target students served by the program. Lrancis and Van 
conveyed that during the current year, most ELL students at Sheldon High School were 
taught in sheltered instructional classes. They felt that the campus leaders’ emphasis on 
state assessment performance led them to provide classroom assessments for ESL 
students that incorporated more of the state assessment format during the current year. 
Both Lrancis and Van noted that there was little coordination with other ESL 
mathematics teachers and little additional campus support for ESL students. 
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Common Themes 

Four common themes that emerged from the interviews were: (a) intensified state 
assessment focus, (b) recent changes in ESL instruction, (c) ineffective state 
Linguistically Accommodated Testing, and (d) ELL student problematic identification. 

Theme: Intensified State Assessment Locus 

Teachers from each campus setting described the goal of their classroom 
assessments as preparing students for the state assessments. Mary and Cathy from Erwin 
High School discussed their preference for exposing students to the state assessment 
format and the English language more often than Amy, Lrancis and Van. Erwin High 
School teachers Mary and Cathy provided quizzes once a week with coordinated testing 
by all Algebra teachers twice every six weeks. Although both provided open-ended 
questions requiring students to show their work, Mary and Cathy tested their students 
more often than the other teachers did. Amy from Alton High School also described her 
focus on the state assessment and used curriculum written so that state assessment 
preparation was embedded in the instruction. Students at Alton High School were 
assessed at the completion of every full chapter, typically every two or three weeks. In 
addition, Amy’s students were allowed to suspend their progress on the regular 
curriculum and focus on state assessment preparation. Lrancis and Van from Sheldon 
High School described testing their students once every two weeks. Within a six-week 
grading period, two of the tests they administered were traditional paper-and-pencil tests, 
and one of those tests was a presentation or demonstration of knowledge. Both Lrancis 
and Van described their tests as incorporating more of the state assessment objectives and 
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mirroring the state assessment format during the current school year than in the previous 
year. 



Decisions Against the Use of Authentic Assessments 

Some teachers described their personal experiences with changing their 
assessment choices from those used in the prior year. Francis from Sheldon High School 
described her experience with the use of alternative assessments: 

Last year we did a neat program with lots of presentations for all the kids; and, of 

course, they are challenging; but the ELL [students] did it, they did their scenario 

in English, and then would have to explain how they got their answer. 

Despite her positive experience during the last year, Erancis described her current 
assessments as “our tests incorporate more of the [state assessment objectives].” Van 
agreed with her but expressed concern over his decision by stating, “The presentations 
take longer to conduct. Now our tests incorporate more of the [state assessment], and it’s 
unfortunate.” Mary described using assessments that “require students to show their 
work” but did not consider those assessment alternatives to the paper-and-pencil tests. 
Both Cathy and Amy did not describe using any other type of assessment method. 

Individual Student Pressure for Assessment Results 

The teachers were aware that students were unable to perform well on state 
assessments because of their lack of proficiency in English. Van from Sheldon High 
School said, “I know I have had students where I know they know the subject; if you had 
the question written out in numbers they could do the problem. If there are words, they 
can’t do it.” Cathy from Erwin High School described the challenge in helping students 




attain proficiency and her decision to let the grade reflect the failing performance. She 
stated, 
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I have a student whose last grade was 4th grade; they are already 15 years old but 
don’t have the schooling. But, you are still moving that bar up. We don’t see any 
benefit in moving them forward because if they passed on to another teacher, they 
are going to be tested at the exact same level regardless of whether they speak the 
language or not; so we really would be hard on them if we didn’t do that [fail 
them]. 

Amy from Alton High School shared a different perspective on grading and explained 
that her campus was structured to assist failing students: 



I know that you can’t expect this student to answer with the same grammatical 
expertise or properly done as another AP student in the same classroom. All of 
the students are mixed. All tests are modified, so the other students are not aware 
of the grading or assessment modifications. 

Amy, however, spoke of the performance of ELL students at Alton High School and 

stated: 



One student is almost 21 years old and must complete the credits and the state exit 
exam by that age. Another student is accelerating his pace to complete high 
school in three years [in order to qualify for a scholarship]. Two weeks ago they 
both took the exit exam, one as a repeater and the other as an accelerated student. 

The pressure on students to succeed on state assessments is not limited to one type of 

student. Amy described the diverse students she taught and their unique circumstances. 



which made it a challenge for them to pass the exit test and graduate from high school. 
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Theme: Recent changes in ESL instruction 
Lack of Instructional Continuity 

Teachers from Erwin and Sheldon High School experienced some change in the 
structure of classes offered for ESL students over the last year and felt that the prior 
year’s instructional and assessment practices were more effective. Mary and Cathy from 
Erwin High School witnessed a reduction in the number of sheltered instruction classes 
offered for ELL students, describing that this year most ELL students received instruction 
in regular mathematics classes as part of a regular ESL program. Both teachers were 
unhappy with the change, and Mary stated. 

In years past we used to have three Algebra I ESL classes, two Geometry and two 
Social Studies. This year they were going to do away with the ESL classes, and 
we had to fight for them. Now there is only one Algebra I, one Geometry and one 
Social Studies [class]. They are taking away these classes [and are now in regular 
classes]. 

Erancis and Van from Sheldon High School also described differences in the 
approach to language instruction since the previous year. Both stated that Spanish 
language was used in their ESL classrooms more often in the previous year. During the 
current year they focused on students’ understanding of English mathematical terms and 
concepts, and most of the instruction was conducted entirely in English. Other teachers 
expressed similar transitions in the use of Spanish in the classroom and agreed with 
Erancis’ comment below: 



Last year I did speak in Spanish to the class, but this year I am doing it all in 
English and make them learn the words in English. As the [graduation] gets 
closer, I tell them they have to learn the English. I use a lot of cognates and go 
over the words and help them make connections. 
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Inconsistent Teacher and Student Support 

The teaehers described a lack of support for both faculty and students. Mary 
shared that “we used to have an ESL specialist, but I don’t think she is ealled a specialist 
anymore. All other [ESL] teaehers teaeh Reading, Writing, Soeial Studies, and Scienee.” 
Erancis and Van also deseribed a lack of support among ELL teachers at Sheldon High 
Sehool and shared that “there is not much communication between the math ELL 
teaehers” and “we should communicate with the ESL teachers, but we don’t.” Mary and 
Cathy from Erwin High School also described a reduetion in the support offered to ESL 
students as opposed to the previous school year. They said, however, that ESL teachers 
continued to provide assistance beyond their time in the elassroom and they added, 
“students come to us and we make ourselves available to them.” 

Theme: Ineffective Assessments 

State Linguistieally Aecommodated Testing (EAT) 

Lour of the five teaehers generally agreed that the state Linguistieally 
Accommodated tests (EAT) for LEP students are ineffective. Teaehers from Erwin and 
Sheldon High School described the training material for assisting both teachers and 
students in the administration of the EAT tests as “useless.” Most of the teachers 
interviewed had served as test administrators for the EAT assessment in the prior year. 
Test administrators may translate test instructions during EAT administrations and 
provide additional elarifieation of test instruetions; however, they may only provide 
direct translations of each test question. School districts give all mathematics teachers a 
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Math Glossary that includes the English to Spanish and Spanish to English translations of 
mathematieal terms. Glossaries help students to prepare for EAT assessments. Mary, 
Cathy, Eraneis and Van reiterated the idea that typieal ESE students understand neither 
the English mathematieal term nor the aeademie eoneept of the term. In other words, they 
have never been exposed to the Spanish term for the mathematieal eoneept. In addition, 
administrators of the EAT may only direetly translate the test questions, leaving students 
unclear about phrasing found on the assessment. Mary provided an example of a student 
reading a EAT assessment question that ineluded the word “silo.” The student was 
unfamiliar with the English word and the Spanish translation, and test administrators 
eould not assist the student without deseribing the word “silo” as a eylindrieal objeet. 

Spanish Eanguage Versions of Assessment Instruments 

The teaehers held surprisingly mixed viewpoints regarding the use of the Spanish 
or home language assessments. Mary from Erwin High Sehool shared that she did not 
use Spanish language tests. She stated, “They have the same test [as the others]. I never 
test them in Spanish.” Eraneis from Sheldon High Sehool agreed and added, “I assess 
them the same way as I do the regular students, but I allow them to write out their 
information in Spanish but ask them to please also write in English.” Amy from Alton 
High Sehool shared her assessment ehoiees as “ESE students either write all in English, 
or get the English and Spanish versions of the tests. The same test (either English or 
Spanish) is provided.” 
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Theme: Problematie Student Identification 

Identification of ELL Students 

All teachers in this study considered the identification of ELL students as a 
problem. Teachers on each campus agreed that students should be identified as ELL 
students at the beginning of the school year; however, each year they encounter instances 
where students were “discovered to have trouble with the language,” and were 
“misplaced,” or were “not identified at all” as ELL students. All teachers described some 
difficulty in getting campus leaders to identify certain students as ELL students. They 
stated, “I don’t think the teacher referral is used enough” and “the person I refer them to 
will not agree with me.” Only one teacher described some misplacement of ELL students 
who knew the English language and likely did not need ESL instruction. 

Identification of Special Education Students 

The most disturbing aspect of student misidentification was the description of a 
set of ELL students referred to campus leaders for possible identification as special 
education students. Mary described recommending “a bunch of students since they were 
failing [repeatedly], not because of the language, but because of some other problem like 
a learning disability.” According to the state Guide to the Admission, Review, and 
Dismissal Process for special education students, the first three steps for identifying 
special education students are to (a) make a referral, (b) contact the parents, and (c) 
obtain written parental consent to evaluate (TEA, 2002b). After realizing that none of the 
students had proceeded with the special education evaluation process, Mary learned that 
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the students were not proeessed beeause of the lack of parental consent. Mary and Cathy 
agreed the situation was frustrating. Cathy claimed: 



There is a learning disability when the last grade they were in was the 4th Grade, 
and then they are trying to come back five years or ten years later to a higher 
education. It might not be their brain, but how can you move them [in five 
months] from a 4th Grade level to a 9th Grade level in English? 

Mary and Cathy expressed great concern for the lack of understanding by school leaders 

of the cultural differences and personal issues experienced by recent immigrant LEP 

students on their campus. 




CHAPTER V 



CONCLUSION 

Emerging from the ease study data were four themes: (a) an intensified foeus on 
state assessments, (b) ehanges in ESL instruetion at the eampuses, (c) ineffeetive state 
assessments for EEEs and (d) problematie identifieation of EEEs. The findings show that 
teaehers in this study felt pressure to help their EEEs to sueeeed on the state assessments 
and thus, adjusted or abandoned what they knew to be best praetiee. In addition, the 
teaehers were seleeting elassroom assessments that helped their students to perform well 
on state assessments but whieh may not aeeurately measure EEE aeademie progress or 
lead to effeetive instruetion. The following seetion will diseuss the findings in light of 
the theoretieal framework presented in the literature review. 

Eour underlying theories support this framework. Eirst, Cummins’ threshold 
hypothesis (NAEDIC, 2007) assumed students must aehieve a eertain level of profieiency 
in the first language for seeond language attainment. Second, Collier and Thomas (2005) 
provided clear evidence to support the use of dual language bilingual education 
instruction over separate or sheltered instruction. Third, Kulm (1993) presented a theory 
based on his findings of the effective use of authentic assessments for mathematics 
instruction. Einally, several other studies concluded that teacher assessment choices were 
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driven by several personal and external faetors. A summary of the external pressure 
plaeed on eaeh of the seleeted eampus sites by state and federal aeeountability systems is 
provided, followed by recommendations for classroom practices and future research. 

Theoretical Framework of the Study 



Threshold Hypothesis 

The teachers in this study shared their views of the use of Spanish in the 
classroom. Although the primary home language of most ELL students on each campus 
site was Spanish, the teachers said that they used Spanish in the classroom much less than 
in the previous school year. The teachers differed in their opinion as to whether it was 
helpful to students for their teacher to use Spanish to instruct students in mathematics. 
Most used Spanish while teaching but focused on the students’ English proficiency. This 
finding contradicts Cummins’ threshold hypothesis that supported the continued 
development of students’ proficiency in their first language in order to learn a second 
one. 

Effective Instruction 

Next, the teachers described their teaching responsibilities and shared information 
that may have influenced their assessment choices. Of the five interviewees, three taught 
ESL sheltered instruction classes and two taught mainstream mathematics classes with 
ESL students included. School districts are not required to offer bilingual instruction for 
secondary level students (TAC, 2006). In addition, teachers shared that the district had 



reduced the number of sheltered instruction classes available for ELL students and had 
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placed them in mainstream classes. The findings in the study seem to eontradiet the 
eonelusions by Collier and Thomas (2005) who showed that dual language bilingual 
instruetion was more effective than sheltered instruction for ELL students. 

Authentie Assessments 

Of the teachers interviewed, only two provided information on their use of 
alternative or authentie assessments, and both mentioned that they had redueed the 
number of alternative assessment methods over the previous year. All teaehers were 
aware of authentie assessments, but they ehose to use traditional paper-and-pencil 
assessments. This finding eontradiets Kulm’s (1993) theory that mathematics teachers’ 
should use alternative assessments beeause they are effeetive for teaehing higher-order 
thinking. 

Assessment Choiees and External Pressures 

The teaehers also deseribed their deeision to focus on student performanee on 
state assessments. The assessment ehoiees reflected an inerease in the use of traditional 
objeetive assessment formats that mirror the statewide assessment. This finding supports 
several studies that indieated that teacher assessment ehoiees were driven by personal and 
external faetors (Abrams, 2004; Cheng, Rogers, & Hu, 2004; Rex & Nelson, 2004; 
Sanehez & Brisk, 2004). A review of the state and federal aeeountability results for eaeh 
of the three eampuses explain the growing pressure experieneed by the study partieipants. 
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External Pressure on Case Study Sites 

Tables 5 and 6 show the state and federal aeeountability results for all three 
eampus sites. It is important to note the differenee between the state aeeountability rating 
and the federal aeeountability results. The state aeeountability rating of “Aeademleally 
Aceeptable” for each of the three campuses over the last three years indicated that there 
had been no change on the campus in terms of student performance. This state rating 
system did not measure the performance results of LEP students separately in any of the 
indicators (TEA, 2006a). Based on the state accountability ratings over the last three 
years, there would likely have not been any cause for concern for the performance of 
EEE students. 

The federal accountability rating for each of the three campuses illustrated a 
dramatically different result. Erwin High School campus failed to make Adequate Yearly 
Progress in 2004, 2005, and 2006 (TEA, 2006b). In both 2005 and 2006, the campus 
failed to meet AYP due in part to the performance of students identified in the EEP 
student group. The 2006, AYP performance results for the EEP student group indicated 
22% of the students meeting the proficiency standard. In addition, the campus had 
previously been identified as “In Need of School Improvement” under the federal Title I 
provisions and the additional failure to meet AYP in 2006 moved that campus into the 
next level of school improvement intervention (TEA, 2006b; TEA, 2006e). 

Alton High School’s federal accountability results were similar to the state 
accountability results. The number of EEE students on this campus small and was 
essentially not evaluated for either the state or AYP determinations. The campus 
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provided instruction as a means for dropout prevention, with success on the state required 
TAKS Exit exam as a goal for each student. If students do not meet proficiency on the 
state Exit exam, they do not receive a high school diploma (TAG, 2006). Given the high 
stakes involved for each student, teachers were naturally focused on providing instruction 
and assessments that help students attain success on the TAKS Exit exams. 

The federal accountability results for Sheldon High School revealed a change in 
the EEP student group performance in 2006. The campus met AYP in 2004 and 2005 in 
all student groups, and the EEP student group was not large enough for evaluation (TEA, 
2006e). However, the only student group that failed to meet the AYP standard for 
mathematics in 2006 was the EEP student group. Since this was the first failure of 
Sheldon High School to meet AYP in three years, the campus was not identified for any 
further school improvement interventions (TEA, 2006b; TEA, 2006e). 

Recommendations 

Additional comments provided by the interviewees suggest ways that EEE 
assessments choices of mathematics teachers may improve. Naturally, one solution to 
removing the external pressures on mathematics teachers is to alleviate the high stakes 
involved for students and campuses on state assessments. Although some interviewees 
alluded to that notion, most thought that the attention to the performance of EEP students 
was long overdue. The complete exclusion of EEP students from state assessments was 
never presented as a solution, but the teachers were clear that students needed more time 
to learn the English language in order to be successful on state assessments. The state 
and federal accountability systems should consider including EEP student performance in 
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campus evaluation yet should allow some number of years for the students to reaeh 
aeademie language profieieney and therefore, profieieney on state assessments. 

Another reeommendation for effeetive ELL instruetion and assessment is the 
promotion of ELL instruetion in the student’s first language. Cummins’ threshold 
hypothesis (NALDIC, 2007) eneourages the use of the native language in instruetion. If 
the pressure of external assessments was removed, then the teaehers eould redireet their 
instruetion to promote the development of students’ profieieney in their first language, 
along with mathematieal eontent before transitioning to profieieney in a seeond language. 
Linally, promoting dual language bilingual edueation in all grade levels, particularly 
secondary grades, would allow teaehers to provide the most effeetive instruetion to ELL 
students. Collier and Thomas’ (2005) study of effeetive ELL instruetion provided elear 
evidenee of the best praetiee for teaehers of ELL students. Without the pressure of 
statewide assessments and with adequate resources for seeondary dual language 
instruetion, teaehers eould instruet ELL students in their own language as they gain 
profieieney in mathematieal eontent and progress in the knowledge of the English 
language. 



Luture Research 

The purpose of this study was to determine the assessment praetiees of seeondary 
mathematics teachers for use with ELL students. As shown by the history of edueational 
poliey for instrueting ELL students, edueation researeh on the effeetive assessment of 
ELL students is still lacking and is now in demand due to the implementation of NCLB in 
2003. More researeh is needed on the topie. Speeifieally, more in-depth researeh is 




53 



needed to identify the most effective mathematics classroom assessments for ELL 
students. Studies to support the appropriate large-scale assessment of ELL students 
would be useful, along with more research on the appropriate length of time to provide 
instruction prior to inclusion of ELL students in statewide assessments. 

Lurthermore, more studies are needed to effectively measure the academic 
progress of ELL students in either their primary or secondary language. Although the 
participants of this case study were concerned with the lack of academic or language 
proficiency of ELL students, there appears to be little or no effort toward accurately 
measuring the extent of their academic knowledge. Research is needed to identify 
accurate measures of academic progress of ELL students without the influence of 
external factors, such as high-stakes state assessments, that can then be used by 
classroom teachers. 



Conclusion 

Cummins’ threshold hypothesis supports the development of a student’s level of 
proficiency in the first language in order to learn a second language (NALDIC, 2007). 

The findings of this study showed that the teachers interviewed were increasingly using 
only English in their classrooms instruction while they focused on the student’s 
proficiency in the English language. Collier and Thomas (2005) found that dual language 
bilingual education instruction is most effective with LLP students. This study found that 
secondary teachers are not required to teach bilingual education and that students were 
placed in classes on the selected campus sites in either sheltered instruction or 
mainstreamed, regular classes with ESL students. Kulm (1993) presented his theory on 
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the effective use of authentic assessments for mathematics instruction. Teachers 
interviewed for this study either never used or reduced their use of alternative or 
authentic assessments. Teacher assessment choices are driven by personal and external 
factors (Abrams, 2004; Cheng, Rogers, & Hu, 2004; Rex & Nelson, 2004; Sanchez & 
Brisk, 2004). The state administered tests results for the study campus sites selected were 
high profile and used for state or federal accountability ratings or for students to attain a 
high school diploma. The existence of state level assessments drive the behavior of the 
participants of this study, as secondary mathematics teacher assessment practices for ELL 
students mirror the state assessments across all three campuses. 

The history of effective instruction for ELL students in Texas has been affected 
by a changing political climate and public opinion of the requirement to provide a free 
and public education for recent immigrant students (Walsh, 2005). Currently, classroom 
assessment practices for ELL students by teachers in this study seemed to indicate that 
the pendulum may have swung too far. Although there are unprecedented high profile 
results indicating the need for better ELL instruction, the requirement of having all LEP 
students succeed on state assessments distorts effective assessment and effective 
instruction (Abrams, 2004). Educators must use the most effective assessment methods 
when measuring the progress of ELL students in order to make well-informed decisions 
regarding classrooms instruction for these students. 
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Participant Consent Form 



March 2007 



“Secondary Mathematics Teacher Assessment Practices for Use with 
English Language Learners” 



Secondary Mathematics Teacher, 

My name is Ester Regalado, and I am a graduate student pursuing my master’s degree at Texas State 
University - San Marcos. This project focuses on the classroom assessments of students with limited 
English proficiency. You have been selected to participate in this study because you are a secondary 
mathematics teacher of English language learners. The project will consist of two teacher interviews and 
an examination of the assessments that you use with English language learners. The purpose of this form is 
to request your participation in this study. 

I have obtained permission to conduct this study from the school district and the principal. The results of 
this study will be shared with my supervising professor, your school district research staff and campus 
principal. Please read the information below and sign if you are willing to participate in this study. If you 
have any questions, please contact me at (512) 787-5272 or my supervising professor. Dr. Nathan Bond, at 
(512) 245-3098. 



Consent Form 

Your signature below indicates that you have read the information and that you have agreed to participate 
in the study. It also indicates that you agree to with the following conditions. 

1 . The interviews will be conducted at the school during the lunch hour, after school, or at a time 
convenient to you. The length of the interviews will be 25 - 30 minutes. 

2. All information obtained from the study will be confidential. 

3. By conducting the study, the results will help mathematics and ESL educators understand 
strategies used for the assessment of students. 

4. There are no risks anticipated by participating in this study. 

5. The results of the study will be analyzed and shared with the researcher’s supervising professor. 

6. You are entitled to a copy of this consent form. 

7. In return for participation in this project, a copy of the final research study will be provided to you. 

8. Your participation is optional. Your decision to participate or not participate will not affect future 
relations with Texas State University at San Marcos, with your school district, nor with your 
campus principal. If you decide to participate in the study, you reserve the right to discontinue 
participation at any time. 



Signature of Teacher 



Date 



Signature of Researcher 



Date 
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TEACHER INTERVIEW GUIDE 



Questions that are asked to all interviewees: 



Warm-up Question: Tell me a little about yourself. 



• Demographic 

a) age 

b) gender 

e) ethnieity 

d) years of experienee 

e) are you multilingual? 

• Teaeher preparation / Did their pre-serviee education courses provide training in 
this area? 

• Advanced training / Have they participated in professional development training 
in working with ELL students? 

• Years of teaching experience 

• Years at this school / What kind of support have they received from their campus 
administration in meeting the needs of these students? 

• Teaching responsibilities this year 

• What is your basic philosophy/approach towards working with ELL students? 
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TEACHER INTERVIEW GUIDE (continued) 

• Ask of all interviewees: 

1 . What are some of the ways that you assess your students’ eontent knowledge? 

2. What are the reasons for using these types of assessments? 

3. How often do you assess your students? 

4. What are some ways that you determine if students are not profieient in English? 

5. After you have identified an ELL, do you try to determine how profieient the student 
is in English? Based on the partieipant’s answer: 

• Yes: How do you determine the student’s language profieiency level? 

• No: What are your reasons for not determining a student’s profieieney level? 

6. Do you modify your assessments for ELL students? Based on partieipant’s answer: 

• Modify: In what ways do you modify your assessments for ELL students? 

Do you use linguistie modifieations, or ehange the language for ease of 
understanding? 

Do you modify the assessment in other ways, sueh as more white spaee, or 
speeial aeeommodations? 

• Don’t modify: What are your reasons for not modifying your assessments? 

7. What do you do for native English speaking students who are not doing well on the 
assessments? 

8. What do you do for ELL students who are not doing well on assessments? 

9. What support systems or serviees are available on your eampus to help you teaeh 
ELL students? 

10. Do you eollaborate with the ESL teaeher? If so, how? If not, why not? 

1 1 . What support systems or serviees are available on your eampus to help your ELL 
students? 

12. How do you determine a student’s six weeks average? What is your grading system? 

13. Do you grade your ELL students differently? Based on participant’s answer: 

• Yes: In what ways do you grade your ELL students differently? 

• No: What are your reasons for not modifying your grading system? 

14. May I review your lesson plans for classes with ESL students? 
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